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TEST EXECUTIVE SYSTEM 
WITH A TAPE RECORDER TYPE CONTROL INTERFACE 

BACKGROUND OF THE INVENTION 

5 1. Field of the Invention 

The present invention relates to electronic systems for performing automated 
tests of complex electronic, electromechanical and mechanical equipment and 
products. More particularly, the present invention relates to an electronic test system 
with a graphical control interface that resembles that of a tape recorder to enable the 
10 user to efficiently control the execution of a test. 
2. Statement of the Problem 

Test systems are used to check status and performance of complex electronic, 

J* electromechanical and mechanical products and equipment. Such tests can include 

£3 



□ validation tests which run through the various operations that the device under test 

£3 

fyl5 (DUT) is capable of and records whether each operation was performed properly, 
environmental tests which expose the DUT to various combinations of temperature, 
pressure, and humidity, and records the results, production tests, etc. Generally, both 



m 



the DUT and the systems providing the environmental and other constraints on the 
^ DUT are controlled electronically. In the last decade or so, computerized programs 
jHZO which are capable of controlling a variety of automated tests, referred to in the art as 
M "test executive" programs, have been developed. 

Test executive programs in the prior art include internal test executive 
programs developed by Agilent Technologies and TESTSTAND software developed 
by National Instruments Corporation, which is described as a ready-to-run test 
25 executive for organizing, controlling, and executing automated prototype, validation, 
or production test systems. The prior art Agilent Technologies programs did not use 
a graphical user interface (GUI); therefore, they did not allow the user to interact easily 
with the test software. The TESTSTAND software, while using a GUI, utilizes a 
conventional interface for a Windows™ program adapted to a test environment. 
30 Tests usually are defined by a set of rules or specifications to which the DUT 

response is compared. The rules or specifications generally comprise various inputs 
defined by electrical and mechanical parameters applied to the DUT, such as voltage, 
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current, specified manipulations of controls and device parts, as well as environmental 
parameters under which the test is conducted, such as temperature, humidity, 
pressure, and the time period over which a parameter is applied. Each test will 
include many combinations of the parameters applied to each element of the DUT, 
5 and often will be repeated many times. Thus, as equipment and products become 
more complex, electronic test programs have become very long and complex, often 
requiring several days, or even a week or more to run a complete test. 

In prior art test systems, the control of the execution of the test is limited to the 
usual commands "Run Test" and "Abort Test". The user does not have simple means 
10 to command the test system to repeat a particular phase in the test without restarting 
the whole test program from the beginning or involving additional programming. As 
p a result of starting from the beginning, the user wastes valuable time and valuable 

m 
a 
ru 
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1015 which, at any given point in a lengthy test, the execution of a test can be controlled in 



results. 

Therefore, it would be highly desirable to have a test executive system in 



a manner to change its course without additional programming steps or a waste of 
valuable time. 



s 

M 

M 

M SUMMARY OF THE INVENTION 

p The present invention solves the above and other problems in the prior art by 

u 

20 allowing the user to control the execution of the entire procedure on a small, intuitive 
graphical display called a control interface. The control interface enables the user to 
quickly perform functions such as aborting or stopping the execution of a test, pausing 
the execution of a test, restarting the test, restarting a particular measurement in a 
test, skipping a measurement in a test, or skipping a test. The ability to control the 

25 execution of a test allows the user to save time by immediately taking action and 
modifying some of the elements of the execution process. The user is not constrained 
to wait to the end of the test procedure nor is the user constrained to completely abort 
the procedure in the event that a particular measurement has not performed properly 
according to a set of rules, or specifications, but instead can immediately take action 

30 to change the course of the test procedure. The present invention is easy to use and 
does not involve additional programming for executing the control commands. 
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The electronic test output is displayed through an easy to use graphical user 
interface. It is divided into windows containing either icons for controlling the test 
procedure or windows for displaying the results of the test. The user can control the 
test procedure by accessing the programs represented by the icons and windows with 
5 a pointing device such as a mouse, a keyboard, a trackball, a touch pad, a roller ball, 
or a joystick. 

The portion of the display containing the control interface is preferably a small 
portion of the graphical user interface (GUI) where the control commands are 
displayed as icons. Preferably, the icons are displayed on a window as buttons. 
10 Preferably, the buttons have labels relating information on the function of each button. 

The control interface allows the user to send instructions to the test procedure 

C3 so that the test procedure responds to the commands by changing the course of the 

C3 

P execution of the test procedure. 

Preferably, each command is assigned to a single icon in such a manner that, 

Ifl 5 when the user "clicks" on the icon using an input device, the test program responds 

\§ 



accordingly. 

^ Preferably, the command buttons are displayed as in a "tape recorder" wherein 

M each button is assigned a recognizable and intuitive function, such as the functions 
p used in a tape recorder or video cassette recorder (VCR), e.g., "play", "pause", 
' 20 "rewind", and "fast forward". The designs on the buttons are recognizable symbols 
for such "play", "pause", "rewind", and "fast forward" functions. Since most people in 
developed countries today are familiar with tape recorders, VCRs and CD-ROM 
players that utilize such interfaces, a typical user recognizes and is familiar with both 
the functions behind each symbol and the symbols. 
25 Preferably, the test program has a hierarchical structure and the control 

interface permits the user to separately control different levels of the hierarchy. That 
is, the results are displayed in a multilevel structure having a highest level and one or 
more sublevels. Preferably, the levels of the hierarchy, starting from the highest level, 
are procedure, test, measurement, and datapoint. That is, the test procedure contains 
30 an ensemble of tests, each containing one or more measurements, and each 
measurement contains one or more datapoints. Preferably, the control interface 
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allows the user to select the execution of the test program at a specific level in a test 
procedure. For example, the user can skip a particular test in the test procedure, 
therefore skipping dependent measurements and datapoints in the test. The user can 
also opt to skip a particular measurement in a specific test. Alternatively, the user can 
5 repeat a measurement in a test or repeat the execution of a specific test in a test 
procedure. 

The present invention not only provides simple controls for the execution of an 
electronic test, but also displays the controls in an intuitive way. Other features, 
objects and advantages of the invention will become apparent from the following 
10 description when read in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
J* FIG. 1 is a block diagram showing the principal hardware components of the 

S3 preferred embodiment of the present invention connected to a device under test; 

C3 

FIG. 2 is a block diagram showing the hierarchical structure of the preferred 
lip embodiment of a test program according to the invention; 

fcS FIG. 3 shows a view of the graphical user interface of the electronic test system 

l»* with a control interface according to the invention; and 



C3 



FIGS. 4 through 6 show alternative embodiments of a control interface 
according to the invention. 



H20 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present invention relates to an electronic test system with a control 
interface that enables the user to easily and intuitively control the execution of test 
programs. Referring to FIG. 1 f in the preferred embodiment, the test system 
comprises a computer 100, including a memory 101, a microprocessor 102, an input 

25 device 104, and an output device 106. Memory 101 communicates with 
microprocessor 102 via electrical line 110. Input device 104 communicates with 
microprocessor 102 through electrical line 112. Microprocessor 102 outputs the data 
through output device 106 via electrical line 1 14. 

In another embodiment, the test system can take the form of software stored 

30 in memory 101 and run or executed by processor 102. The user interacts with the test 
system through input device 104 such as, but not limited to, a keyboard, a mouse, a 
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track ball, a touch pad, or a joystick. Input device 1 04 moves a cursor or a pointer on 
output device 106, which is a display system such as a cathode ray tube monitor or 
a liquid crystal display. The results of the test, as well as the control interface, are 
displayed on output device 106. The test is controlled by processor 102, which 
5 communicates the instructions of the test program to the product under test or device 
under test (DUT) 108 via electrical line 116. Processor 102 controls the test 
equipment 1 17 via electrical line 118. The test results are processed by processor 
102 and stored in memory 101 to be visualized by display 106. The display 
information contains both information as to the configuration and position of the cursor 
10 and other visual information of interest to the user, such as the results of the test and 
other graphical elements for controlling the execution of the test procedure. 

The invention may be implemented in a variety of actual electronic devices that 

O 

13 follow the general form outlined on FIG. 1. For example, the test system may be 
ry imbedded in a computer system, or it may also be imbedded in the hardware as a 
J|l5 logic circuit, or embodied as an electronic testing device such as, but not limited to, 
%Q an electronic analyzer. 

u. The electronic test system or electronic test program of the present invention 

f* is stored in memory 101 to be managed and executed by processor 102. The 

f* 

»P electronic test system is a series of instructions that are executed by the processor via 

P 

y20 communication between memory 101 , processor 102, and device under test 108, as 
well as transmission of commands between input device 104 and processor 102 via 
electrical line 112. The results, as well as the input parameters, are displayed as text 
and graphics on output device 106. 

To better understand the workings of the invention, it is helpful to describe the 

25 hierarchical structure of the preferred test program of the present invention, and the 
order in which the test is performed. Referring to FIG. 2, there is shown a block 
diagram 200 illustrating the hierarchical, i.e., multi-level, characteristic of the test 
program. Herein, we shall refer to the broadest or most inclusive level as the "highest 
level" or "first level", though this choice is arbitrary. The first level 201 corresponds to 

30 the product model, a file the test developer creates to test a family of specific device 
model numbers. It contains test procedures and inputs. 
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The next level 202 corresponds to the procedure itself. A procedure is an 
ordered list, sequence, or script of tests to be run. Several procedures may exist, 
which is represented in FIG. 2 by a deck of cards 202, each representing a different 
procedure. Each procedure includes a plurality of tests, i.e., test 1, test 2, test 3 . . . 
5 test N, as shown at 203. Each test includes a plurality of measurements. This is 
illustrated in FIG. 2 for test 2 shown at 205. As shown, test 205 includes 
measurements 207, i.e., measurement 1, measurement 2 . . . measurement N. Each 
measurement includes one or more datapoints, each datapoint represented as one 
of the cards 210, 21 1, 212 in a stack of cards 214 associated with each measurement. 
10 A procedure is defined by writing a program or a code to build a structure of software 
objects. In one embodiment, the software objects are COM objects. COM is a 
M language independent component architecture, not a programming language. It is 
p meant to be a general purpose, object-oriented means to encapsulate commonly used 
I** functions and services. See Newton's Telecom Dictionary by Harry Newton, 

£015 Publishers Group West, page 197. 

iff 

A test 205 is a group of measurements 207 in a procedure 202 that share the 
^ same test algorithm or the same test software code. Some examples of tests include 
H amplitude accuracy test, test of harmonic distortion, etc. The test program repeatedly 

,p calls a test for each measurement and datapoint. 

n 

y20 A measurement, such as measurement 206, is a configuration or a setup for 

a test. Each measurement, in measurements 207, within a test 205 can have different 
setups or configuration parameters. Tests are parameter driven and the parameters 
are inputs at the measurement level. Measurements are elements such as range in 
volts, frequency in kilohertz or harmonic (an integer number). The test procedure 202 

25 views measurements 207 as data to be passed from the procedure to a test. A 
measurement is also a phase of test execution. During the measurement phase of 
test execution, the measurement is started but data is not collected. This allows for 
multiple devices under test (DUTs) to be configured and triggered together. 

A datapoint such as 210, 21 1 , 212, is a subset of a measurement, such as 206, 

30 containing additional parameters that select a result when one measurement 
generates multiple results. Some examples of multiple datapoints for a measurement 
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are the minimum and maximum of a spectrum analyzer sweep or each channel of a 
device. 

For each datapoint, such as 210, in measurement 206, a value result is 
extracted. The results obtained are compared to specifications. Specifications are 
5 numerical limits, string match, or Boolean pass/fail. There are three sets of limits: 
marginal limits, line limits and customer limits. Each limit has an upper and a lower 
value. 

All the inputs and outputs of the electronic test system 100 (FIG. 1) are, 
preferably, handled through a graphical user interface. FIG. 3 shows a graphical user 
10 interface 300 comprising buttons 301 displayed on an output device 106. Each button 
has a graphical element, such as 380, associated with it that conveys a command for 
controlling test system 100. From left to right, the buttons control: abort 302, restart 

£3 test 303, restart measurement 304, pause 305, run 306, skip measurement 307, skip 

□ 

j^y test 308. Button 302 is used to abort the test procedure in case the user determines 

fj*L5 that the test is not running properly. Button 303 is used to restart a test. This is 

\% performed when the user determines that a specific test must be rerun. Button 304 

9 

I* is used to restart a measurement. This is performed when the user determines that 

M 

a specific measurement is to be redone. Button 305 is used to momentarily stop the 
*F execution of a test procedure. This button is engaged in case the user wants to 



•asa 



y20 perform a task on the DUT or test system, for instance, checking a parameter or 
verifying various test settings, etc. Button 306 is used to start the test procedure. This 
button is activated to start the procedure or to restart the procedure after momentarily 
freezing the execution of the test procedure, i.e., after engaging "pause" button 305. 
Button 307 is activated when the user wishes to skip a specific measurement. 
25 Similarly, button 308 is activated when the user wishes to skip a particular test. 

Buttons 303 or 304 can be engaged multiple times to back up the procedure 
execution by multiple tests or measurements, respectively. Buttons 307 or 308 can 
be engaged multiple times to skip multiple measurements or tests, respectively. 

The bottom of the screen 309 shows a window describing the hierarchy of 
30 tests, measurements, and datapoints. Icons indicate pass, fail, marginal, and not yet 
tested. A "smiling" 310, "surprised" 31 1 , and "sad" 312 icons correspond respectively 
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to pass, marginal, and fail. The pass/fail icon 313 on top of the window is for the 
entire procedure. It summarizes the status of all the tests with the fail having priority. 
That is, if there is one fail test, the whole procedure is fail. The Boolean operator 
"AND" is used to compute the final status of the procedure. 
5 The right side 314 of the graphical user interface 300 shows a window 340 

comprising a series of rows, such as 315, and columns, such as 316. Window 340 
displays the time 317 the test is run, as well as the status of the test 318. This window 
also displays the test that is being carried out, such as amplitude accuracy in 319, the 
type of measurement, such as (range=5Vp, Frequency=1kHz) in 320, the datapoint 
10 or channel under test, such as (Ch=1 , Ch=2, Ch=3) in 321 , the value or result of the 
measurement, such as (0.1235 dB) in 322, the specification, such as (" 0.2) in 323, 
and the frequency, such as (1kHz) in 324. The test can be sorted by clicking on the 



Q icon view on top of the window 325. This allows the test results to be filtered and 

C3 

fy displayed depending on their status. The bottom right window 330 is a progress 

j|jl5 window indicating the progress of the test procedure. 

*P An alternative embodiment of the control interface 400, according to the 

s 

M invention, is shown on FIG. 4. Referring to FIG. 4, the control interface is comprised 
y ? of graphical elements that can take the form 400. The control interface 400 is 
Jrj imbedded as a series of physical buttons 401 - 404 on the lower part of output device 
M20 406 such as, but not limited to, a computer monitor. The control buttons, such as 401 , 
402, 403, are designed as round-buttons in this embodiment. To avoid confusion 
between restart test and restart measurement, different symbols are put on button 402 
and button 403. Similarly, to avoid confusion between skip test and skip 
measurement, different symbols are put on button 404 and button 405. Button 410 
25 represents the ON/OFF button of output device 106. 

Other alternative embodiments of the control interface are shown in FIG. 5 and 
FIG. 6 where the different buttons are arranged in two different configurations 500 and 
600 on input device 514 and 614, respectively, such as a keyboard. In configuration 
500, shown in FIG. 5, the control buttons "abort" 501 , "run" 502 and "pause" 503 are 
30 grouped together for easy access, since these buttons are more frequently used. The 
control buttons 504 "repeat test" and 505 "skip test" are grouped together for easy 
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identification. Similarly, control buttons 506 "repeat measurement" and 507 "skip 
measurement" are also grouped together for easy identification. For example, in 
configuration 500, the control buttons can take the place of the "F" functions on a 
typical keyboard. FIG. 6 shows an alternative embodiment of the control interface 
5 where the control buttons are grouped in configuration 600. In this instance, the 
control buttons are designed and added to keyboard 614. 

The different embodiments of the symbols used and grouping of the buttons on 
interfaces 400, 500, and 600, can, of course, be used in combination with an interface 
on a display, such as shown in FIG. 3, and the symbols and grouping shown on 
10 interface 300 in FIG. 3 can be used in combination with a monitor or keyboard. The 
invention contemplates that other symbols and/or groupings may also be used. 
Moreover, the control interface can be implemented on a remote control which 

□ 

p resembles a remote control of a television or VCR, and any of the groupings and/or 
*y symbols may be used in combination with such a device. 

jjjp There has been described what at present is considered to be the preferred 

\Q embodiment of the invention. It will be understood that the invention can be embodied 
fa in other forms without departing from its spirit or essential characteristics. For 
example, while the invention has been described in terms of an electronic test 

*P program with a graphical control interface, other systems may be implemented based 

C3 

iJZO on hardware or firmware instead of software, or the control interface may not be 
displayed on the graphical user interface but implemented as hardware, in which 
implementation the buttons are physical buttons. The present embodiment is, 
therefore, to be considered as illustrative and not restrictive. The scope of the 
invention is indicated by the appended claims. 
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